멀티 태스킹 환경에서 GPU를 사용한 범용적 계산 응용의 효율적인 시스템 자원 활용을 위한 GPU 시스템 최적화

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 전기·컴퓨터공학부, 2020. 8. 염헌영.Recently, General Purpose GPU (GPGPU) applications are playing key roles in many different research fields, such as high-performance computing (HPC) and deep learning (DL). The common feature exists in these applications is that all of them require massive computation power, which follows the high parallelism characteristics of the graphics processing unit (GPU). However, because of the resource usage pattern of each GPGPU application varies, a single application cannot fully exploit the GPU systems resources to achieve the best performance of the GPU since the GPU system is designed to provide system-level fairness to all applications instead of optimizing for a specific type. GPU multitasking can address the issue by co-locating multiple kernels with diverse resource usage patterns to share the GPU resource in parallel. However, the current GPU mul- titasking scheme focuses just on co-launching the kernels rather than making them execute more efficiently. Besides, the current GPU multitasking scheme is not open-sourced, which makes it more difficult to be optimized, since the GPGPU applications and the GPU system are unaware of the feature of each other. In this dissertation, we claim that using the support from framework between the GPU system and the GPGPU applications without modifying the application can yield better performance. We design and implement the frame- work while addressing two issues in GPGPU applications. First, we introduce a GPU memory checkpointing approach between the host memory and the device memory to address the problem that GPU memory cannot be over-subscripted in a multitasking environment. Second, we present a fine-grained GPU kernel management scheme to avoid the GPU resource under-utilization problem in a i multitasking environment. We implement and evaluate our schemes on a real GPU system. The experimental results show that our proposed approaches can solve the problems related to GPGPU applications than the existing approaches while delivering better performance.최근 범용 GPU (GPGPU) 응용 프로그램은 고성능 컴퓨팅 (HPC) 및 딥 러닝 (DL)과 같은 다양한 연구 분야에서 핵심적인 역할을 수행하고 있다. 이러한 응 용 분야의 공통적인 특성은 거대한 계산 성능이 필요한 것이며 그래픽 처리 장치 (GPU)의 높은 병렬 처리 특성과 매우 적합하다. 그러나 GPU 시스템은 특정 유 형의 응용 프로그램에 최저화하는 대신 모든 응용 프로그램에 시스템 수준의 공정 성을 제공하도록 설계되어 있으며 각 GPGPU 응용 프로그램의 자원 사용 패턴이 다양하기 때문에 단일 응용 프로그램이 GPU 시스템의 리소스를 완전히 활용하여 GPU의 최고 성능을 달성 할 수는 없다. 따라서 GPU 멀티 태스킹은 다양한 리소스 사용 패턴을 가진 여러 응용 프로그 램을 함께 배치하여 GPU 리소스를 공유함으로써 GPU 자원 사용률 저하 문제를 해결할 수 있다. 그러나 기존 GPU 멀티 태스킹 기술은 자원 사용률 관점에서 응 용 프로그램의 효율적인 실행보다 공동으로 실행하는 데 중점을 둔다. 또한 현재 GPU 멀티 태스킹 기술은 오픈 소스가 아니므로 응용 프로그램과 GPU 시스템이 서로의 기능을 인식하지 못하기 때문에 최적화하기가 더 어려울 수도 있다. 본 논문에서는 응용 프로그램을 수정 없이 GPU 시스템과 GPGPU 응용 사 이의 프레임워크를 통해 사용하면 보다 높은 응용성능과 자원 사용을 보일 수 있음을 증명하고자 한다. 그러기 위해 GPU 태스크 관리 프레임워크를 개발하여 GPU 멀티 태스킹 환경에서 발생하는 두 가지 문제를 해결하였다. 첫째, 멀티 태 스킹 환경에서 GPU 메모리 초과 할당할 수 없는 문제를 해결하기 위해 호스트 메모리와 디바이스 메모리에 체크포인트 방식을 도입하였다. 둘째, 멀티 태스킹 환 경에서 GPU 자원 사용율 저하 문제를 해결하기 위해 더욱 세분화 된 GPU 커널 관리 시스템을 제시하였다. 본 논문에서는 제안한 방법들의 효과를 증명하기 위해 실제 GPU 시스템에 92 구현하고 그 성능을 평가하였다. 제안한 접근방식이 기존 접근 방식보다 GPGPU 응용 프로그램과 관련된 문제를 해결할 수 있으며 더 높은 성능을 제공할 수 있음을 확인할 수 있었다.Chapter 1 Introduction 1 1.1 Motivation 2 1.2 Contribution . 7 1.3 Outline 8 Chapter 2 Background 10 2.1 GraphicsProcessingUnit(GPU) and CUDA 10 2.2 CheckpointandRestart . 11 2.3 ResourceSharingModel. 11 2.4 CUDAContext 12 2.5 GPUThreadBlockScheduling . 13 2.6 Multi-ProcessServicewithHyper-Q 13 Chapter 3 Checkpoint based solution for GPU memory over- subscription problem 16 3.1 Motivation 16 3.2 RelatedWork. 18 3.3 DesignandImplementation . 20 3.3.1 System Design 21 3.3.2 CUDAAPIwrappingmodule 22 3.3.3 Scheduler . 28 3.4 Evaluation. 31 3.4.1 Evaluationsetup . 31 3.4.2 OverheadofFlexGPU 32 3.4.3 Performance with GPU Benchmark Suits 34 3.4.4 Performance with Real-world Workloads 36 3.4.5 Performance of workloads composed of multiple applications 39 3.5 Summary 42 Chapter 4 A Workload-aware Fine-grained Resource Manage- ment Framework for GPGPUs 43 4.1 Motivation 43 4.2 RelatedWork. 45 4.2.1 GPUresourcesharing 45 4.2.2 GPUscheduling . 46 4.3 DesignandImplementation . 47 4.3.1 SystemArchitecture . 47 4.3.2 CUDAAPIWrappingModule . 49 4.3.3 smCompactorRuntime . 50 4.3.4 ImplementationDetails . 57 4.4 Analysis on the relation between performance and workload usage pattern 60 4.4.1 WorkloadDefinition . 60 4.4.2 Analysisonperformancesaturation 60 4.4.3 Predict the necessary SMs and thread blocks for best performance . 64 4.5 Evaluation. 69 4.5.1 EvaluationMethodology. 70 4.5.2 OverheadofsmCompactor . 71 4.5.3 Performance with Different Thread Block Counts on Dif- ferentNumberofSMs 72 4.5.4 Performance with Concurrent Kernel and Resource Sharing 74 4.6 Summary . 79 Chapter 5 Conclusion. 81 요약. 92Docto

A posteriori error bounds for the block-Lanczos method for matrix function approximation

We extend the error bounds from [SIMAX, Vol. 43, Iss. 2, pp. 787-811 (2022)] for the Lanczos method for matrix function approximation to the block algorithm. Numerical experiments suggest that our bounds are fairly robust to changing block size and have the potential for use as a practical stopping criteria. Further experiments work towards a better understanding of how certain hyperparameters should be chosen in order to maximize the quality of the error bounds, even in the previously studied block-size one case

Evaluation of diffuse mismatch model for phonon scattering at disordered interfaces

Diffuse phonon scattering strongly affects the phonon transport through a disordered interface. The often-used diffuse mismatch model assumes that phonons lose memory of their origin after being scattered by the interface. Using mode-resolved atomic Green's function simulation, we demonstrate that diffuse phonon scattering by a single disordered interface cannot make a phonon lose its memory and thus the applicability of diffusive mismatch model is limited. An analytical expression for diffuse scattering probability based on the continuum approximation is also derived and shown to work reasonably well at low frequencies.Comment: 13 pages, 7 figure

Ab initio study of electron mean free paths and thermoelectric properties of lead telluride

Last few years have witnessed significant enhancement of thermoelectric figure of merit of lead telluride (PbTe) via nanostructuring. Despite the experimental progress, current understanding of the electron transport in PbTe is based on either band structure calculation using first principles with constant relaxation time approximation or empirical models, both relying on adjustable parameters obtained by fitting experimental data. Here, we report parameter-free first-principles calculation of electron and phonon transport properties of PbTe, including mode-by-mode electron-phonon scattering analysis, leading to detailed information on electron mean free paths and the contributions of electrons and phonons with different mean free paths to thermoelectric transport properties in PbTe. Such information will help to rationalize the use and optimization of nanostructures to achieve high thermoelectric figure of merit

Dirac-Electrons-Mediated Magnetic Proximity Effect in Topological Insulator / Magnetic Insulator Heterostructures

The possible realization of dissipationless chiral edge current in a topological insulator / magnetic insulator heterostructure is based on the condition that the magnetic proximity exchange coupling at the interface is dominated by the Dirac surface states of the topological insulator. Here we report a polarized neutron reflectometry observation of Dirac electrons mediated magnetic proximity effect in a bulk-insulating topological insulator (Bi$_{0.2}$Sb$_{0.8}$)$_{2}$Te$_{3}$ / magnetic insulator EuS heterostructure. We are able to maximize the proximity induced magnetism by applying an electrical back gate to tune the Fermi level of topological insulator to be close to the charge neutral point. A phenomenological model based on diamagnetic screening is developed to explain the suppressed proximity induced magnetism at high carrier density. Our work paves the way to utilize the magnetic proximity effect at the topological insulator/magnetic insulator hetero-interface for low-power spintronic applications.Comment: 5 pages main text with 4 figures; 2 pages supplemental materials; suggestions and discussions are welcome

Exposure time relevance of response to nitrite exposure: Insight from transcriptional responses of immune and antioxidant defense in the crayfish, Procambarus clarkii

Abstract(#br)To understand the toxic effects of nitrite exposure on crayfish, expression of genes involved in the immune system, the antioxidant defense, and the heat shock protein 70 (HSP70) was measured after 12, 24, and 48 h of different nitrite concentrations exposure in the hepatopancreas and hemocytes of Procambarus clarkii . Nitrite exposure up-regulated mRNA levels of cytoplasmic Mn superoxide dismutase (cMn-SOD), catalase (CAT), glutathione peroxidase (GPx), and glutathione-S-transferase (GST), after 24 h nitrite exposure. At 48 h, nitrite exposure decreased the mRNA levels of mitochondrial MnSOD (mMn-SOD), CAT, and GPx. High concentrations of nitrite at 48 h of exposure decreased expression of β-1,3-glucan-bingding protein in the hepatopancreas, and lysozyme expression in hemocytes. Nitrite exposure caused little effect on the heat shock protein 70 (HSP70) in hemocytes. Through overall clustering analysis, we found that 24 h of nitrite exposure caused stronger transcriptional responses. Our study indicated that the response of P. clarkii to acute nitrite exposure was exposure time-dependent. These results will help to understand the dynamic response pattern of crustaceans to nitrite pollution, and improve our understanding of the toxicological mechanisms of nitrite in crustaceans

rad21 Is Involved in Corneal Stroma Development by Regulating Neural Crest Migration

Previously, we identified RAD21(R450C) from a peripheral sclerocornea pedigree. Injection of this rad21 variant mRNA into Xenopus laevis embryos disrupted the organization of corneal stroma fibrils. To understand the mechanisms of RAD21-mediated corneal stroma defects, gene expression and chromosome conformation analysis were performed using cells from family members affected by peripheral sclerocornea. Both gene expression and chromosome conformation of cell adhesion genes were affected in cells carrying the heterozygous rad21 variant. Since cell migration is essential in early embryonic development and sclerocornea is a congenital disease, we studied neural crest migration during cornea development in X. laevis embryos. In X. laevis embryos injected with rad21 mutant mRNA, neural crest migration was disrupted, and the number of neural crest-derived periocular mesenchymes decreased significantly in the corneal stroma region. Our data indicate that the RAD21(R450C) variant contributes to peripheral sclerocornea by modifying chromosome conformation and gene expression, therefore disturbing neural crest cell migration, which suggests RAD21 plays a key role in corneal stroma development